ASPIRE for excellence in curriculum development.

The objective of the ASPIRE award programme of the International Association for Health Professions Education is to go beyond traditional accreditation processes. Working in partnership with the ASPIRE Academy, the programme aims to encourage and support excellence in health professions education, in part by showcasing and exemplifying best practices. Each year ASPIRE award applications received from institutions across the globe describe their greatest achievements in a variety of areas, one of which is curriculum development, where evaluation of applications is carried out using a framework of six domains. These are described in this paper as key elements of excellence, specifically, Organisational Structure and Curriculum Management; Underlying Educational Strategy; Content Specification and Pedagogy; Teaching and Learning Methods and Environment; Assessment, Monitoring and Evaluation; Scholarship. Using examples from the content of submissions of three medical schools from very different settings that have been successful in the past few years, achievements in education processes and outcomes of institutions around the world are highlighted in ways that are relevant to their local and societal contexts.

Acquire, apply, and activate knowledge: A pyramid model for teaching and integrating cultural competence in medical curricula.

The importance of cultural competence in health care has been more acknowledged since modern societies are becoming increasingly multi-cultural. Research evidence shows that cultural competence is associated with improved skills and patient satisfaction, and it also seems to have a positive impact on adherence to therapy. Based on this evidence, the acknowledged importance of cultural competence and its poor integration into medical curricula, we present a pyramid model for building cultural competence into medical curricula whereby medical students can enhance their skills through acquiring, applying and activating knowledge.

Global sharing, local innovation: Four schools, four countries, one curriculum.

BACKGROUND: Many internal and external obstacles, must be overcome when establishing a new medical school, or when radically revising an existing medical curriculum. AIMS: Twenty-five years after the Flinders University curriculum was introduced as the first graduate-entry medical programme (GEMP) in Australia, we aim at describing how it has been adopted and adapted by several other schools, in Australia and in Europe (UK, Ireland, and Portugal). METHOD/RESULTS: This paper reports on the experience of four schools establishing a new medical school or new curriculum at different times and in different settings. CONCLUSIONS: We believe that these experiences might be of interest to others contemplating a similar development.

Faculty development through international exchange: the IMEX initiative.

BACKGROUND: Faculty development is often local and international experiences are usually limited to conferences and courses. In 2006, five schools across the globe decided to enhance international faculty experiences through an exciting new collaboration: the International Medical Educators Exchange (IMEX) initiative. METHOD: Twice a year, one of the five schools in the Netherlands, Canada, Sweden and the UK organizes a week of faculty development activities for experienced medical educators from each school, including group discussions, short presentations, observations and active engagement in local education, one-on-one meetings with local faculty members, and many opportunities for in-depth discussion. We administered a survey to evaluate the impact of this international exchange. RESULTS: By August 2013, 31 IMEX scholars had attended at least one of the 14 site visits held; most of them (29) had attended 3-5 site visits. Responding IMEX alumni (55%, N = 16) felt that their experiences impacted their personal competence and international orientation, and to some extent their career, their daily work and their institution. Most features of the IMEX program were valued as highly important and highly successful. DISCUSSION: IMEX has established itself as an important additional faculty development opportunity for those medical educators who wish to develop and pursue a career in education.

Expert validation of fit-for-purpose guidelines for designing programmes of assessment.

BACKGROUND: An assessment programme, a purposeful mix of assessment activities, is necessary to achieve a complete picture of assessee competence. High quality assessment programmes exist, however, design requirements for such programmes are still unclear. We developed guidelines for design based on an earlier developed framework which identified areas to be covered. A fitness-for-purpose approach defining quality was adopted to develop and validate guidelines. METHODS: First, in a brainstorm, ideas were generated, followed by structured interviews with 9 international assessment experts. Then, guidelines were fine-tuned through analysis of the interviews. Finally, validation was based on expert consensus via member checking. RESULTS: In total 72 guidelines were developed and in this paper the most salient guidelines are discussed. The guidelines are related and grouped per layer of the framework. Some guidelines were so generic that these are applicable in any design consideration. These are: the principle of proportionality, rationales should underpin each decisions, and requirement of expertise. Logically, many guidelines focus on practical aspects of assessment. Some guidelines were found to be clear and concrete, others were less straightforward and were phrased more as issues for contemplation. CONCLUSIONS: The set of guidelines is comprehensive and not bound to a specific context or educational approach. From the fitness-for-purpose principle, guidelines are eclectic, requiring expertise judgement to use them appropriately in different contexts. Further validation studies to test practicality are required.

Assessment for selection for the health care professions and specialty training: consensus statement and recommendations from the Ottawa 2010 Conference.

Assessment for selection in medicine and the health professions should follow the same quality assurance processes as in-course assessment. The literature on selection is limited and is not strongly theoretical or conceptual. For written testing, there is evidence of the predictive validity of Medical College Admission Test (MCAT) for medical school and licensing examination performance. There is also evidence for the predictive validity of grade point average, particularly in combination with MCAT for graduate entry but little evidence about the predictive validity of school leaver scores. Interviews have not been shown to be robust selection measures. Studies of multiple mini-interviews have indicated good predictive validity and reliability. Of other measures used in selection, only the growing interest in personality testing appears to warrant future work. Widening access to medical and health professional programmes is an increasing priority and relates to the social accountability mandate of medical and health professional schools. While traditional selection measures do discriminate against various population groups, there is little evidence on the effect of non-traditional measures in widening access. Preparation and outreach programmes show most promise. In summary, the areas of consensus for assessment for selection are small in number. Recommendations for future action focus on the adoption of principles of good assessment and curriculum alignment, use of multi-method programmatic approaches, development of interdisciplinary frameworks and utilisation of sophisticated measurement models. The social accountability mandate of medical and health professional schools demands that social inclusion, workforce issues and widening of access are embedded in the principles of good assessment for selection.

The principles and best practice of question writing for postgraduate examinations.

Postgraduate medical education has changed enormously in the last 10 years presenting huge logistical challenges for local, regional and national organisations. Assessment is under change in line with major revisions of postgraduate curricula. Old methods of assessment are changing to newer evidence-based methods supported by ongoing research into good practice. This review examines the purpose and practical considerations of written assessment, the pros and cons of different assessment methods and how good practice can be evaluated and quality assured. Good quality assessment comes at a cost in terms of time and money, and organisations need to invest in their assessment strategies to ensure the highest possible standards.

A model of clinical problem-based learning for clinical attachments in medicine.

CONTEXT: Problem-based learning (PBL) has been widely adopted in medical curricula for early-years training, but its use during clinical attachments has not been extensively explored. Objectives This study aimed to develop and evaluate a new model, 'clinical problem-based learning' (CPBL), to promote learning skills, attitudes and knowledge during clinical attachments. METHODS: The CPBL model takes the principles of PBL and applies them to learning during clinical attachments. Real patient encounters are guided by a list of broadly defined case types to ensure curriculum coverage. By discussing history taking and examination in the context of differential diagnosis and problem listing, students generate learning objectives relating to clinical skills, disease mechanisms and clinical management. These are explored through self-directed learning before the second tutorial, in which the tutor takes the role of 'expert', demonstrating how learned material translates into clinical practice. We evaluated which components contributed most to the success of the model using semi-structured questionnaires, focus groups and a consensus (Delphi process) method. RESULTS: Students found CPBL a positive learning experience. Identification of suitable cases for discussion was readily achieved, although follow-up was sometimes difficult. The tutor's level of expertise and a non-threatening learning environment, conducive to student questioning, were highly rated contributors to successful CPBL. Comments reinforced the view that CPBL is a parallel teaching approach that helps structure the teaching week, but does not replace traditional bedside teaching. CONCLUSIONS: Clinical problem-based learning was well received in clinical placements. Key elements were the learning interval, the involvement of expert tutors and a non-threatening learning environment.

Variations in medical school graduating examinations in the United Kingdom: are clinical competence standards comparable?

BACKGROUND: While all graduates from medical schools in the UK are granted the same licence to practise by the medical professional regulatory body, the General Medical Council, individuals institution set their own graduating examination systems. Previous studies have suggested that the equivalence of passing standards across different medical schools cannot be guaranteed. AIMS: To explore and formally document the graduating examinations being used in the UK Medical Schools and to evaluate whether it is possible to make plausible comparisons in relation to the standard of clinical competence of graduates. METHODS: A questionnaire survey of all the UK medical schools was conducted, asking for details of graduating examination systems, including the format and content of tests, testing time and standard setting procedures. RESULTS: Graduating assessment systems vary widely across institutions in the UK, in terms of format, length, content and standard setting procedures. CONCLUSIONS: We question whether is it possible to make plausible comparisons in relation to the equivalence of standards of graduates from the different UK medical schools, as current quality assurance systems do not allow for formal quantitative comparisons of the clinical competence of graduates from different schools. We suggest that national qualifying level examinations should be considered in the UK.

Models for the development of graduate entry medical courses: two case studies.

INTRODUCTION: The introduction of graduate entry medical courses requires attention to models of decision-making and change. Much of the educational literature describes change as either centralised or decentralised with the latter claimed to be more effective. Recently Fullan has argued for the importance of an ongoing culture of change. This paper examines the change culture of two medical schools adopting graduate entry courses; Flinders University in South Australia and St George's Hospital Medical School, London. METHOD: Comparative case study was used. Key informants were interviewed and documents and records analysed. Data were cross-checked and categorised to generate models of change. RESULTS: There were four components of the change culture at Flinders but they were not sufficient on their own to generate change. The process was triggered by a significant external event. The nature of the change was also important. The descriptive model developed suggested a complex interplay of factors rather than attributing the success of the change to the change mechanisms adopted alone. The model was tested for explanatory potential at St George's. The culture there was described as both 'macro-innovative' and 'micro-conservative'. External events were also important but they exerted a positive force. A more centralised approach was adopted. DISCUSSION: The models developed represent change as 'dynamic, complex and open' rather than a simple centralised or decentralised dichotomy. While some of the elements of a change culture were evident at both schools there were longer term questions of sustainability. This has implications for development of all programmes but particularly for graduate entry schools.

'It teaches you what to expect in future . . . ': interprofessional learning on a training ward for medical, nursing, occupational therapy and physiotherapy students.

AIM: This paper presents findings from a multimethod evaluation of an interprofessional training ward placement for medical, nursing, occupational therapy and physiotherapy students. CONTEXT: Unique in the UK, and following the pioneering work at Linköping, the training ward allowed senior pre-qualification students, under the supervision of practitioners, to plan and deliver interprofessional care for a group of orthopaedic and rheumatology patients. This responsibility enabled students to develop profession-specific skills and competencies in dealing with patients. It also allowed them to enhance their teamworking skills in an interprofessional environment. Student teams were supported by facilitators who ensured medical care was optimal, led reflective sessions and facilitated students' problem solving. METHODS: Data were collected from all groups of participants involved in the ward: students, facilitators and patients. Methods included questionnaires, interviews and observations. RESULTS AND DISCUSSION: Findings are presented from each participating group, with a particular emphasis placed on the perspective of medicine. The study found that students valued highly the experiential learning they received on the ward and felt the ward prepared them more effectively for future practice. However, many encountered difficulties adopting an autonomous learning style during their placement. Despite enjoying their work on the ward, facilitators were concerned that the demands of their role could result in 'burn-out'. Patients enjoyed their ward experience and scored higher on a range of satisfaction indicators than a comparative group of patients. CONCLUSIONS: Participants were generally positive about the training ward. All considered that it was a worthwhile experience and felt the ward should recommence in the near future.